WO 99/54867 PCT/NZ99/00049 /)^fc7 

la^CT/PTO 2 0 OCT 



J^Ip^LIHEj yygLjrREF^ 

SYSTEM FOR ENHANCINGA£OJISHGS 



TECHNICAL FIELD 



Best Available Copy 



The invention comprises an in-line early reflection enhancement system and 
method for enhancing the acoustics of a room or auditorium. 

BACKGROUND 

The acoustics of a room has a significant impact on an audience's perception of the 
quality of a live performance. There are a number of properties of rooms that have 
been identified as being correlated to subjective impressions of quality. The earliest 
measured parameter was the reverberation time. This is a global property of the 
room which has a similar value at all locations. It is governed by the room volume 
and the absorption of the room surfaces, and the quality of reverberation is also 
governed by the room shape. Rooms with a long reverberation time can provide a- 
sense of envelopment which produces an increased enjoyment of performances 
such as opera or classical music. However, the same acoustics can reduce the 
intelligibility of the spoken word, and therefore be unsuitable for speech. 

Other parameters have been determined which relate to the properties of the early 
part of the response, such as the clarity. More recent auditoria have been designed 
with reflectors specifically placed to enhance the early part of the room response to 
sounds emanating from the stage. 

To achieve maximum enjoyment of a variety of performances, the acoustics of a 
room must be matched to the intended performance. Many rooms have for this 
reason been made acoustically adjustable. For example adjustable absorbers such 
as moveable curtains or rotatable panels have been used to control reverberation 
time. Extra acoustic spaces have been constructed which can be coupled to the 
main area when required to provide more reverberance. 
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Electroacoustic systems have been used for many years to enhance the acoustics of 
rooms. The simplest system is the public address or sound reinforcement system in 
which the sound produced by performers on stage is detected by close microphones 
and the sound amplified and broadcast from one or more sets of loudspeakers. The 
goal of such systems is typically to project the direct, unreverberated, sound to the 
audience to eliminate the effects of the room and improve clarity. 

More recently, more complex forms of sound system have been developed which aim 
to provxde adjustable room acoustics. The basic sound reinforcement system has 
been further developed by introducing sound processing elements such as delays 
winch allow the creation of additional sound reflections - see W. Anhert, "Complex 
simulation of acoustic fields by the delta stereophony system (DDS),» J. Audio Eng: 
Soc, vol. 35, no. 9, pp 643-652, September 1987, and US patent 5,142,586. The 
delta stereophony system described by Anhert provides sound reflections that are 
arranged to arrive later than the direct sound, in order to maintain correct 
localisation. For a given receiver location, the appropriate delays can be chosen to 
avoid preceding the direct sound, but the delays must be changed for different 
receiver positions. The ACS system described in US patent 5,142,586 claims to 
provide reflections at the appropriate times for all receiver positions, by the creation 
of wavefronts. The delays are chosen using Huygens principle, and their 
quantification mathematically by integral equations is described by A J. BerKnout, 
D. de Vries, and P. Vogel, "Acoustic control by wave field synthesis/ J. Acoust Soc 
Am., vol. 93, no. 5, pp 2764-2778, May 1993. The wavefronts are generated using 
loudspeaker arrays. These electroacoustic systems offer a more controllable early 
reflection response than can be achieved using passive reflectors. 

Reverberators have also been introduced to provide a larger reverberation time for 
sources on stage - see for example US patent 5,109,419. Larger numbers of 
speakers .have also been employed to provide enhanced reflections and 
reverberation, such as to under balcony areas. The microphones have also been 
positioned further from the performers so as to be less obtrusive, while still aiming 
to detect the direct sound. 



35 



The systems discussed above avoid feedback from the loudspeakers to the 
microphones, since such feedback can lead to colouration and instability if the loop 
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gain is too high. Because of this fact, they may be generically termed in-line, or non- 
regenerative, systems. Such systems can provide large increases in reverberation for 
sound sources that are close to the microphones (ie on stage), but they have a small 
effect for sound sources at other positions in the room. 

A second type of enhancement system is the non-in-line, or regenerative, system, 
which seeks to utilise the feedback between loudspeakers and microphones to 
achieve a global enhancement of reverberation that occurs for any sound source 
position - see A. Krokstad, a Electroacoustic means of controlling auditorium 
acoustics," Applied Acoustics, vol. 24, pp 275-288, 1998 and F. Kawakami and Y. 
Shimizu, "Active field control in auditorial Applied Acoustics, vol. 31, pp 47-75, 
1990. Since the natural, unassisted reverberation time is largely the same for all 
source positions, the regenerative systems can provide a more natural enhanced 
reverberation. Non-in-line systems typically use a large number of independent 
microphone, amplifier, loudspeaker channels, each with a low loop gain. Each 
channel provides a small enhancement of reverberation at all frequencies, with low 
risk of colouration, and the combined effect of all the channels is a significant 
increase in reverberation and loudness. The microphones are positioned in the 
reverberant field from all sound sources in the room to ensure that the system 
produces. a similar enhancement for all sources. Non- in-line systems, however, 
have typically required from 60 to 120 channels, and have therefore been expensive. 
Furthermore, since the microphones are remote from all sources, they are less 
suited to providing significant early reflections than in-line systems. 

More recently, a non-in-line system has been developed which uses a multichannel 
reverberator between the microphones and loudspeakers to provide an increase in 
reverberation time without requiring an increase in loop gain - see US patent 
5,862,233. It has been shown that the system can both reduce the apparent room 
absorption (by increasing the loop gain) and increase the apparent room volume ^by 
increasing the reverberation time of the reverberator) - see M. A. Poletti, 'The 
performance of a new assisted reverberation system,' 1 Acta Acustica, 2 December 
1994, pp 511-524. In general, a hybrid room enhancement system may be 
constructed in which some of the microphones of a non-in-line system containing a 
reverberator are moved close to the source. In this case the system demonstrates 
properties of both in-line and non-in-line systems - see M. A. Poletti, The analysis 
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of a general assisted reverberation system," accepted for publication in Acta Acustica 
vol. 84, pp 766-775, 1998. 

When used solely for early reflection enhancement, an in-line system provides a 
finite number of delayed outputs to simulate early reflections. However, if operated 
at moderate to high gaxns, the system runs the risk of instability. This is particularly 
hkely if new delays/ reflections are added which will increase the loop gain at some 
frequencies. 

In any sound system, it is important that the chrect acoustic sound from the stage 
arrives at every member of the audience before (or at the same time as) any 
electroacoustic signal. This is because the perception of localisation is governed by 
the first signal to arrive at the ears (provided later signals are not overly large) 
Hence, care must be taken in both in-line and non-in-line systems to ensure that 
the electroacoustic signals are suitably delayed. In a non-in-line system this can be 
achieved by keeping the microphones a suitable distance from the stage. Delays can 
be used in in-line systems and non-in-line systems to avoid preceding the direct 
sound. Care must therefore be taken in any non-in-line system where microphones 
are moved close to the stage. 

SUMMARY OF INVENTION 

In broad terms in one aspect the invention comprises an in-line early reflection 

generation system comprising: 

25 one or more microphones positioned close to one or more sound sources so as to 
detect predominantly direct sound; 

an early reflection generation stage which generates a number of delayed 
reproductions of the microphone signals and which has unitary power gain whereby 
the stability of the system is independent of the delay times and amplitudes; 
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a number of loudspeakers placed to broadcast the early reflected energy into the 



room. 
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The in-line early reflection generation stage may include a number of delay lines 
which are preceded or followed by cross coupling matrices. 

The system and method of the invention do not attempt to optimise the delay time 
for individual receiver positions as in delta stereophony, nor create wavefronts as in 
the ACS system. Instead, early reflections are generated in such a way that the 
stability of the system is maximised. This is achieved by ensuring that the reflection 
generation circuit has a unitary property. 

In the system and method of the invention unitary circuit principles are applied to 
an in-line reflection generation system. In any early reflection system there is a 
finite level feedback of sound from the loudspeakers to the microphones via the 
reverberant field in the room. The generation of multiple reflections via multiple 
delays and amplitude weightings in prior art early reflection systems increases the 
risk of instability by creating variations in the loop gain both below and above the 
levels that would have existed without the system. 

However, if the system has a transfer function matrix which is unitary, then the 
power gain of the system is one at all frequencies, and the stability of the sound 
system is not compromised by the insertion of the early reflection system. 

Suppose the matrix of transfer functions through the early reflection system is X(f). 
The unitary property states that 

X H X=I 1 

where the H superscript denotes the conjugate transpose of the matrix. Consider a 
single frequency f 0 applied to each input of X, with amplitude A n and phase <|> n . The 
input signal si n (t) may be written 



where u is the complex amplitude vector 
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u = [A x e* 9 A 2 e* 9 ...,A„e»»] T 
The total output power is 



since X is unitary. Hence, the power gain of a unitary system is one at ali 
frequencies, and does not aifect stability when inserted into a multichannel system 

which contains feedback. 

US patent number 5,729,613 describes a multi-channel reverberator which has this 
uxutary property. This device provides multiple channels of reverberation while 
mamtauung a constant power gain with frequency, and is designed for application 
in a non-nx-hne system for reverberation time enhancement, as described in US 
patent 5,862,233. The device contains multiple channels of internal feedback which 
creates an infinitely long decaying response, and a rapidly increasing density of 
echoes which are perceived as reverberation. 

In this invention early reflection systems are disclosed which also have a unitary 
property. They are distinguished from the unitary reverberator in that they do not 
contain internal feedback, and do not produce an infinite decaying response 
Instead they produce a finite response consisting of a relatively low number of 
discrete echoes. The response is therefore not perceived as reverberation. 

It is important to note that in the unitary early reflection system of the invention 
there » no recursion in the reflection system, ie there is not feedback of the outputs 
of delay lines to the inputs of delay lines. In contrast to a reverberator the response 
of the reflection system is therefore finite - the response to an impulse is a short 
burst of echoes then silence. Also, the density of the echoes will never reach that of 
a reverberator. Typically system of the invention will have a response time of only 
80ms or so, and the echo density never reaches that of a reverberator. 
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The invention is further described with reference to the accompanying figures, by 
way of example and without intending to be limiting, in which: 

Figure 1 shows the layout of an early reflection system of the invention, 

Figure 2 shows a unitary n-channel delay line system as the early reflection 
generation stage, 

Figure 3 shows a unitary cross-coupled n-channel delay system including an 
orthonormal matrix before the delay lines as the early reflection generation stage, 

Q Figure 4 shows a unitary dual cross-coupled n-channel delay system using 

15 orthonormal matrices both before and after the delay lines as the early reflection 

Sj generation stage, 

Ul 

m 

Q Figure 5 shows a two stage unitary dual cross-coupled n-channel delay system with " 

09 

cascaded orthonormal matrices and delay lines between each two matrices as the 
Q 20 early reflection generation stage, and 



Hi Figure 6 shows a non-in-line assisted reverberation system for controlling the global 

reverberation time of a room or auditorium with which the in-line early reflection 
system of the invention may be combined. 
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DETAILED DESCRIPTION OF PREFERRED FORMS 



Figure 1 shows the layout of an early reflection system of the invention. A number of 
microphones mi to xqn are positioned close to the sources on stage. The microphone 
30 signals are fed to a processor which generates a number of scaled and delayed 
replicas of the N microphone signals, and the processor outputs are fed to amplifiers 
and loudspeakers Li to Lk placed in the room. The transfer function matrix of the 
processor is denoted X(f). 
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The microphones are typically directional, that is, they are sensitive to sound 
sources positioned on axis, and tend to suppress sound sources (and reflections 
and reverberation) which are positioned off-axis. This maximises the direct sound 
pickup and reduces the risk of feedback from the loudspeakers. However, a finite 
level of feedback may still exist, and if the loop gain of the system is too high, the 
system will become unstable. The transfer function matrix from the loudspeakers to 
the microphones is H(f), and the loop transfer function matrix is thus H(f)X(f). If the 
locus of any eigenfunction of H(f)X(f) encircles the point (l +j 0), the system will be 
unstable. 

The stability of the system can be maintained by keeping the loop gain low, for 
example by keeping the amplifier or microphone preamplifier gains low. However, for 
a given setting of amplifier gains, the stability of the system is dependent on the 
particular delay times and delay levels in the processor. Hence, the system stability 
cannot be guaranteed once the amplifier gains are set. However, if X(f) has a 
unitary property, its power gain is unity at all frequencies. The stability is then 
independent of the delay times and levels. 

Unitary early reflection systems of the invention may be constructed using non- 
cross-coupling delay lines and orthononnal cross coupling matrices. The simplest N 
channel system comprises N delay lines connecting N microphone signals to N 
loudspeakers, as shown in figure 2. This system generates a single delay at each 
output for a signal applied to its respective input. The transfer function matrix is 



X=D = 



exp{-yfl?7;} 0 

0 exp{-jo)T 2 } 

0 0 
0 0 

,0 0 



0 

0 ' 

exp{-y<y7 3 } 
0 

0 



0 
0 
0 

txp{-jo)T N } 



This has a diagonal form since there is no cross coupling. The system is unitary 
since D H D=I. 



Figure 3 shows the use of an orthononnal cross coupling matrix in a more complex 
system of the invention. An orthononnal matrix Mi is placed before the delay lines 



8 



WO 99/54867 PCT/NZ99/00049 



Ti-Tn so that a signal applied to any one input is coupled into every delay line, 
resulting in a single scaled and delayed reproduction of that signal at every output. 
The transfer function matrix is 



X = DM l 6 

This system is unitary since both Mi and D are unitary, and the product of unitary 
matrices is unitary. 

Figure 4 shows the use of orthonormal matrices Mi and M 2 both before and after the 
delay lines Ti and Tn. A single impulse applied to one of the inputs is applied to all 
N delay line inputs, and appears at times x n later at the delay outputs. The N 
delayed impulses are then cross coupled to every output. Thus, N output delays are 
generated at each output for a single applied impulse. The circuit thus has the 
property of diffusing the inputs and providing the maximum number of outputs for 
any input. The matrix transfer function of the circuit is the product of the transfer 
function matrices of each section 



X = M 2 DM X 



Figure 5 shows cascading multiple systems of the form in figure 4. This system 
generates N 2 scaled delayed reproductions of a signal applied to any single input at 
every output. Hence the delay density increases rapidly with the number of delay 
stages. 

The early reflection enhancement system of the invention may also be combined 
with a non-in-line I assisted reverberation system for controlling the global 
reverberation time so that the reverberation time is similar for all source positions 
in the room, of the type described in US patent 5,862,233. Such a system comprises 
multiple microphoijfes positioned to pick up predominantly reverberant sound in a 
room, multiple loud speakers to broadcast sound into the room, and a reverberation 
matrix connecting a similar bandwidth signal from each microphone through a 
reverberator hav&g an impulse response consisting of a number of echoes the 
density of which 'increases over time, to a loudspeaker. The reverberation matrix 
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may connect a similar bandwidth signal from each micropWfe through one or more 
reverberators to two or more separate loudspeakers an/each of which receives a 
signal comprising one or more reverberated microphone signal. Figure 6 shows a 
wideband, N microphone, K loudspeaker non-m- Western. Each of microphones, 
mi, m 2 and m 3 picks up the reverberant sound in/frie auditorium. Each microphone 
signal is split into a number of K of separate paths, and each 'copy' of the 
microphone signal is transmitted through yCverberator, (the reverberators typically 
have a similar reverberation time but n&y have a different reverberation time). 
Each microphone signal is connected/ :o each of K loudspeakers through the 
reverberators, with the output of o/e reverberator from each microphone being 
connected to each of the amplifiers/! to A3 and to loudspeakers L, to L 3 as shown ie 
one reverberator signal from eachfaicrophone is connected to each loudspeaker and 
each loudspeaker has connect^ to it the signal from each microphone, through a 
reverberator. In total there It N.K connections between the microphone and the 
i loudspeakers. While in Fi^e 6 each microphone signal is split into K separate 
paths through K reverbefctors resulting in N.K connections to K amplifiers and 
loudspeakers, the micrcfehone signals could be split into less than K paths and 
coupled over less than/k reverberators, ie each loudspeaker may have connected to ' 
it the signal from a/ least two microphones each through a reverberator, but be 
cross-linked with lefes than the total number if microphones. For example, in the 
system of Figure^ the reverberation matrix may split the signal from each of 
microphones mj m 2 and ma to feed two reverberators instead of three, and the 
reverberator output from microphone mi may then be connected to speakers U and 
La, from microphone m 2 to speakers L 3 and L2, and from microphone ma to speakers 
La and L3. /it can be shown that the system performance is governed by the 
minimum ck N and K, and so systems of the invention where N=K are preferred. In 
Figure 6 each loudspeaker indicated by Li, L2 and L 3 could in fact consist of a group 
of two ojf more loudspeakers positioned around an auditorium. In Figure 6 the 
signal jfom the microphones is split prior to the reverberators but the same system 
implemented by passing the supply from each microphone through a single 
reverberator per microphone and then splitting the reverberated microphone signal 
to me loudspeakers. 

simulate: 



The system simulates placing a secondary room in a feedback loop around the main 
With n< 



auditorium *ffth no -two way acoustic coupling. The system allows the 
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reverberatioiydme in the room to be controlled independently of the steady state 
density b^altering the apparent room volume. 

The foregoing describes the invention including preferred forms thereof. Alterations 
and modifications as will be obvious to those skilled in the art are intended to be 
incorporated within the scope hereof. 
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